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(54) Mesh simplification and construction of meshes 



(57) An efficient, lossless, continuous-resolution 
representation (the "PM representation") of highly 
detailed geometric models for computer graphics spec- 
ifies a succession of progressively more detailed polyg- 
onal meshes (i.e., "progressive meshes") as a base 
polygonal mesh and a sequence of complete mesh 
refinement transformations (e.g., the vertex spirt trans- 
formation) that approximate the model at progressively 
finer levels of detail. Procedures for storing and trans- 
mitting geometric models using the PM representation 
address several practical problems in computer graph- 
ics: smooth geomorphing of level-of-detail approxima- 



tions, progressive transmission, mesh compression, 
and selective refinement. An optimized mesh simplifica- 
tion procedure constructs the PM representation of a 
model from an arbitrary polygonal mesh, while preserv- 
ing the geometry of the original mesh as well as its over- 
all appearance as defined by its discrete and scalar 
appearance attributes such as material identifiers, color 
values, normals, and texture coordinates. In particular, 
the PM representation and these procedures preserve 
discontinuity curves such as creases and material 
boundaries of the geometric model. 
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Description 

COPYRIGHT AUTHORIZATION 

5 A portion of the disclosure of this patent document contains material which is subject to copyright protection. The 

copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclo- 
sure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights 
whatsoever. 

70 FIELD OF THE INVENTION 

This invention relates generally to geometric modeling using polygonal meshes for computer graphics, and more 
particularly relates to techniques for optimizing display, storage and transmission of varying level of detail polygonal 
mesh models. 

15 

BACKGROUND AND SUMMARY OF THE INVENTION 

Models in computer graphics are often represented using triangle meshes. Geometrically, a triangle mesh (e.g., 
example portion of a triangle mesh 82 of Fig. 6) is a piecewise linear surface consisting of triangular faces joined 

20 together along their edges. In the following discussion, the geometry of a triangle mesh is denoted by a tuple (K, V), 
where K is a simplicial complex specifying the connectivity of the mesh simplices (i.e., the adjacency of the vertices, 
edges, and faces), and V={v 1t ..., vj\s the set of vertex positions v r (x^y h z^ defining the shape of the mesh in R . 
More precisely, a parametric domain, |K|^R m , is constructed by identifying each vertex of /(With a canonical basis vec- 
tor of R m , and the mesh is defined as the image, M\K\), where ^R^R* is a linear map. (See, ag., H. Hoppe et a!.. 

25 Mesh Optimization, 1993 Computer Graphics Proceedings 1 9-26.) The vertices of a triangle mesh (e.g.. vertices 82-89 
of the mesh 80 of Fig. 6) are denoted as v 1t ...,v m ; the edges (e.g.. 92-95) denoted by pairs of adjacent vertices as 
e={v-,v^: and the faces (e.g., faces 100-107) denoted by triples of interconnected vertices as Hvj,v k , vj. 

\n typical computer graphics applications, surface appearance attrfoutes other than geometry (i.e.. the above 
described simplicial complex and vertex positions tuple (K, V)) are also associated with the mesh. These attributes can 

so be categorized into two types: discrete attributes and scalar attributes. Discrete attributes are usually associated with 
faces of the mesh. A common discrete attribute, the material identifier, determines the shader function used in render- 
ing a face of the mesh, as well as some of the shader function's global parameters. As an example, a trivial shader func- 
tion may involve simple look up within a specified texture map. (See. e.g.. S. Upstill. The RenderMan Companion 
(Addison-Wesley 1990).) 

35 Many scalar attributes are often associated with a mesh, including diffuse color (r,g,b) t normal fn x . ^.n^, ana tex- 
ture coordinates (u,v). More generally, these attributes specify the local parameters of shader functions defined on the 
mesh faces. To capture discontinuities in the scalar f ields. and because adjacent faces may have different shading tunc- - 
tions it is common to associate scalar attributes not with vertices of a mesh, but with its corners. (See, e.g., Apple Com- 
puter Inc., 3d Graphics Programming with QuickDraw 3d (Addison-Wesley 1995).) A corner is defined as a 

40 (vertex.face) tuple. Scalar attributes s (v n at a corner <3=<Vy. y specify the shading parameters for face / at vertex v. As 
an example, to model a crease (a curve on the surface across which the normal field is not smooth), one identifies a 
curve (sequence of edges) in the mesh; at each vertex along its path, the curve partitions the corners into two sets; two 
normals are associated with the vertex, one for each of these sets. A mesh with scalar and discrete surface attributes 
is thus denoted as a tuple M=(K,V t D,S) where D is the set of discrete attributes d f associated with the faces 

45 f={v;,v k ,vt}e K t and S is the set of scalar attributes s (Vif) associated with the corners (v,f) of K. 

In the continuing quest for realism in computer graphics, highly-detailed geometric models are rapidly becoming 
commonplace. Using current modeling systems, authors can create highly detailed geometric models of objects by 
applying versatile modeling operations (e.g., extrusion, constructive solid geometry ("CSG"), and free-form deforma- 
tions ("FFD")) to a vast array of geometric primitives (e.g., non-uniform rational B-spline ("NURBS") and implicit sur- 

so faces ("Blobbies")). (See, T Sederberg and S. Parry. Free-form Deformation of Solid Geometric Models, 1986 
Computer Graphics Proceedings [FFD]; Rockwood, Real-time Rendering of Trimmed Surfaces, 1 989 Computer Graph- 
ics Proceedings [NURBS]; and J. Blinn, A Generalization of Algebraic Surface Drawing, 1982 ACM Transactions on 
Graphics 1(3)235-256 [Blobbies].) For display purposes, these authored models are usually tessellated into triangle 
meshes of the type previously described. Detailed models can also be rapidly obtained by scanning physical objects 

55 with structured light systems, for instance laser range scanners, to also create meshes. In either case, the resulting 
complex meshes are expensive to store, transmit, and render, thus motivating a number of practical problems. 

Mesh Simplification . The meshes created by modeling and scanning systems are typically not optimized for display 
performance. In most applications, these initial meshes can usually be replaced by nearly indistinguishable approxima- 
tions with far fewer faces, thereby improving rendering efficiency. At present, the computer user (e.g., graphical artist or 
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designer) is often responsible for this hand-tuning of meshes, much the same way programmers tinkered with assembly 
code before the advent of optimizing compilers. A lar better approach is to develop mesh simplification tools to auto- 
mate this painstaking task. As another benefit, such tools allow porting of a single model to platforms of varying per- 
formance. 

I Pvftl-nf-Detail Approximation . When a detailed mesh is far from the viewer, it may occupy only a small region of 
the screen. Significant work must be expended to render the mesh only to have it affect a small number of pixels. 
Instead a far coarser mesh (i.e., one with fewer vertices and faces) would look almost identical. To address this prob- 
lem many applications use several versions of a model at various levels of detail. A fully detailed mesh is used when 
the object is close; coarser approximations are substituted as the object recedes. (See. T.A. Funkhouser and C.H. 
Sequin, Adaptive Display Algorithm for Interactive Frame Rates During Visualization of Complex Virtual Environments, 
1993 Computer Graphics Proceedings 247-254). Further, instantaneous switching between two levels-of -detail of a 
given model can lead to a perceptible "popping" display effect. For this reason, the capability of constructing smooth 
visual transitions-called geomorphs-between meshes having different levels-of-detail is desirable. 

PmnrRssive transmission . A complex mesh consumes considerable time to transmit over a communication line, 
often many times longer than it takes to visually render images with views on the mesh. When a mesh is transmitted 
over a communication line, one would like to render views that show progressively better approximations to the model 
as data is incrementally received. The simplest known approach is to render the individual wangles as they are 
received, but of course this looks extremely poor. Another prior approach is to transmit successive level-of-detail 
approximations, but this requires additional transmission time. 

Mesh compression . A model should be stored in the smallest amount of memory or disk space. There have been 
two orthogonal approaches to dealing with this problem. One is to use mesh simplification, as described earlier, to 
reduce the number of faces in the model as much as possible while preserving its appearance. The other is mesh com- 
pression: minimizing the space taken to store the model given that a particular mesh has been selected. 

Rpl^tive refinement . When switching to a more detailed mesh of a level-of-detail representation, detail is added 
uniformly over the model's surface. For some models, it is desirable to refine the mesh only in selected regions. For 
instance, as a user flies over a terrain model, one would like to show the terrain in full detail only near the viewer, and 
only within the field of view. _ . 

There exist a number of mesh simplification techniques that address these problems with varying success. A tech- 
nique described in G. Turk. Re-Tiling Polygonal Surfaces, 1992 Computer Graphics Proceedings 55-64 [hereafter 
"Turk921. sprinkles a set of points on a mesh, with density weighted by estimates of local curvature, and then retnan- 

gulates based on those points. 

Both W J Schroeder et al.. Decimation of Triangle Meshes, 1 992 Computer Graphics Proceedings 65-97 [hereafter 
"Schroeder-etal921 and A. Varshney. Hierarchical Geometric Approximations, PhD thesis. Department of Computer 
Science University of North Carolina at Chapel Hill (1994) [hereafter "Varshney941 describe techniques that iteratvely 
remove vertices from the mesh and retriangulate the resulting holes. The technique in Varshney94 is able to bound the 
maximum error of the approximation to a user-specified tolerance by defining two offset surfaces to the original mesh 

and using combinatorial searching. " ' ^ -, 

H Hoppe et al.. Mesh Optimization, 1993 Computer Graphics Proceedings 19-26 [hereafter Hoppe93] describes 
a technique referred to as mesh optimization, which simplifies an arbitrary original mesh by applying successive trans- 
formations selected from a set including edge collapse, edge split and edge swap so as to minimize an energy function. 
As shown by a graph 25 of Fig. 2 having an accuracy axis 26 and a conciseness axis 27, this energy function explicitly 
models the competing goals of accuracy and conciseness by sampling a dense set of points from the original mesh, 
and using these points to define a distance metric between a more simplified mesh resulting from a selected transfor- 
mation and the original mesh. 

More specifically, the goal of the mesh optimization method described in Hoppe93 is to find a mesh M=(K, V) that 
both accurately fits a set X of points x, e R 3 and has a small number of vertices. This problem is cast as minimization 
of an energy function 

E(M) = E aist (M) + E rep (M) + E spring < 1 > 
of accuracy and conciseness: the distance energy term 

ss measures the total squared distance of the points from the mesh (i.e.. a measurement along the accuracy axis 26). and 
the representation energy term 

Ecre P <M) = c rep m (3) 
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penalizes the number m of vertices in M (i.e., a measurement along the conciseness axis 27). 

The third term, the spring energy E spring (M) is introduced to regularize the optimization problem. It corresponds to 
placing on each edge of the mesh a spring of rest length zero and tension k: 

5 EspringW) = *{j.K}c K * ' < 4 > 

Hoppe93 describes minimizing the energy function E(M) using a nested optimization method having an outer loop 
and an inner loop. In the outer loop, the method optimizes over K, the connectivity of the mesh, by randomly attempting 
a set of three possible mesh transformations: edge collapse, edge split, and edge swap. This set of transformations is 

io complete, in the sense that any simplicial complex K of the same topological type as K can be reached through a 
sequence of these transformations. For each candidate mesh transformation, K -> K\ the continuous optimization 
described below computes E^ t the minimum of E subject to the new connectivity K\ If &E=E K --E K isfoundtobe neg- 
ative, the mesh transformation is applied (akin to a zero-temperature simulated annealing method). 

In the inner loop performed for each candidate mesh transformation, the method computes 

15 E K .= min V E dist (V)+E ^^(V) by optimizing over the vertex positions V. For the sake of efficiency, the algorithm in fact 
optimizes only one vertex position v& and considers only the subset of points X that project onto the neighborhood 
affected byK^HT. 

The regularizing spring energy term E^^M) is found in Hoppe93 to be most important in the early stages of the 
optimization. The optimization method therefore achieves best results by repeatedly invoking the nested optimization 

20 method described above with a schedule of decreasing spring constants k. 

Hoppe93 also demonstrates use of this mesh optimization method as a mesh simplification tool. Given an initial 
mesh M(e.g., example initial arbitrary mesh shown in Fig. 1 (a)) to approximate, a dense set of points X is sampled both 
at the vertices of M and randomly over its faces. The optimization method is then invoked with initial mesh M as the 
starting mesh. By varying the setting of the representation constant c rep , the optimization method takes different paths 

25 '34-36 through a space of possible meshes 38 and thereby can produce optimized meshes M b . M c , and M d with differ- 
ent trade-offs of accuracy and conciseness. For example, Figs. 1(b-d) show views of three example optimized meshes 
M b , M c% and M dt respectively, produced from the example original arbitrary mesh (Fig. 1(a)) by the prior mesh optimi- 
zation method of Hoppe93 for different values of the representation constant c rep . 

J. Rossignac and P. Borrel, Multi-resolution 3D Approximations for Rendering Complex Scenes, Modeling in Com- 

30 puter Graphics 455-465 (Springverlag, New York 1993) [hereafter "Rossignac-Borrel93T describes a technique of 
merging vertices of a model using spatial binning. A unique aspect of their approach is that the topological type of the 
model may change in the process. Their scheme is extremely fast, but since they ignore geometric qualities like curva- 
ture, their approximations are far from optimal. 

The above-described mesh simplification techniques create a discrete hierarchy of simplified models by succes- 

35 sively applying their simplification method several times. Both Turk92 and Rossignac~Borrel93 are able construct geo- 
morphs between the discrete set of models thus created. ^ 

More recently, M. Lounsbery et al., Multiresolution analysis for surfaces of arbitrary topological rype, Technical 
Report 93-T0-05b, (Department of Computer Science and Engineering, University of Washington, January 1994) [here- 
after Lounsbery-etal94] have generalized the concept of multiresolution analysis to surfaces of arbitrary topological 

40 type. M. Eck et al., Multiresolution Analysis of Arbitrary Meshes f 1995 Computer Graphics Proceedings 173-182 [here- 
after "Eck95"] describes how this wavelet-based multiresolution approach can be applied to the approximation of an 
arbitrary mesh. They first construct a parameterization of the mesh over a simple domain, and then expand that param- 
eterization on a wavelet basis. They are able to bound the maximum error between the original mesh and any approx- 
imation. 

45 In the present invention, the above problems are addressed by methods and apparatus for storing, transmitting and 
rendering views of an arbitrary polygonal mesh M using a format, referred to herein as a progressive mesh ("PM") rep- 
resentation, that represents the arbitrary polygonal mesh as a much coarser mesh hfi together with a sequence of n 
detail records that indicate how to incrementally refine h/P exactly back into the original mesh WfcNP . In an illustrated 
embodiment of the invention, each of these records stores information associated with a vertex split, an elementary 

so mesh transformation that adds an additional vertex to the mesh. The PM representation of Mthus defines a continuous 
sequence of meshes M°,/W 7 .....M" of increasing accuracy from which level-of-detail approximations with any desired 
complexity can be efficiently retrieved. Moreover, smooth visual transitions (geomorphs) can be efficiently constructed 
between any two such meshes. In addition, the PM representation naturally supports progressive transmission, offers 
a concise encoding of M itself, and supports efficient selective refinement. In short, the PM representation offers an effi- 

55 cient, lossless, continuous-resolution representation. 

The present invention also provides a new simplification procedure for constructing a PM representation from a 
given mesh M. Unlike previous simplification methods, this procedure seeks to preserve not just the geometry of the 
mesh surface, but also its overall appearance, as defined by the discrete and scalar attributes associated with its sur- 
face. 
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Of the prior mesh simplHication techniques discussed above, the absolution ^^^^^ 

n st the MRA approach utilizes detail terms in the form of wavelets that specify transformations which recursrvely 
«i» a c e s of a bS mesh TOs requires the detail terms or wavelets to lie on a domain with subdMwon cmctarty 
SiT^tM^eSolSiapprradmalion. including the highest, must belong to a restricted class of meshes those 
^sM«l^!Ze^m. An arbitrary initial mesh M (wHh arbitrary connectivity) can only be a P prox,mate.y recov- 

^ctSL"^^ Mention is .ossless. Each detail record is . complete . mesh 

rtlnSiSSSi*^ *** can produce progressive meshes (MV.<n of the PM J^^^ 
tra v ^onneSt As a result, the progressive meshes can be much better approximating geometrically of the ong n* 
SaTm^h StnJn the counted approximating meshes of the MRA approach^ F ,^^^X!tSSi 
model in the continuous-resolution family, NT, is exactly the original arb-trary mesh ^^Xt^7^S) 
MRA aooroach meshes shown in Figs. 4(a-d) to the illustrative PM representation meshes shown .n F.gs. 7(a-d).) 

the surface is not smooth), unless those creases happen to lie parametncally along edges of the base (Jeast leve. or 
SSS, £ pTogresiive meshes constructed according to the invention, however, can .ntroduce surface creases 

attrib^Ssoc^i with the surface. Such attributes include diffuse color, normals, texture coord.nates. material <den- 
ZTrJlw*%Z>*e,s. To represent functions with discontinuities, prior MRA schemes can use P-ecew-se^n- 
SSTi-i ™he r 7T ^~ S£7^S?'SS 

n °Tn^PM^ 

ferent discrete attributes. This is not possible with prior MRA approaches. ^^.^ A^rriminn 

AddSnal features and advantages of the invention will be made apparent from the following deta-led descr.pt.on 
of an illustrated embodiment which proceeds with reference to the accompany.ngdraw.ngs. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Thefile of this patent contains at least one drawing executed in color. Copies o "*P«^*> «*» drawringS wi " 

HOPP F r2 is a graph of accuracy versus conciseness illustrating the results of the prior mesh optimization method 

^^^^^ 

iHuS %? - ^ 192 faces and E = 90 to,erance (F i 4(a)>: 'ZTZ a X mra 

tolerance (fV 4(b); and 15.842 faces and -0.1 tolerance (Fig. 4(c-d))) constructed P"J^ 

o ^proximate an original arbitrary mesh M and illustrating that. in <™^^^ 
bv the illustrated embodiment of the invention which are shown .n F.gs. 8(a-d). the prior M R A approach does inoi 
ricTver ^ Ihfa^arymesh M exactiy. cannot deal effectively with surface creases, and produces .nfer.or qual-ty level- 
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and M 475 with 1000 faces in Figs. 8(c<i)) out of a set of progressive meshes specified in an exemplary PM representa- 
tion according to the illustrated embodiment of the invention. 

Fig. 9(a) is a flow diagram of a method for creating geomorphs between two meshes in a PM representation 
according to the illustrated embodiment. 
5 Fig. 9(b) is a flow diagram of a method for evaluating the geomorphs created by the method of Fig. 9(a). 

Figs. 10(a-j) are views of exemplary geomorphs M°(a) defined between two meshes, IVPfOj-M 175 (with 500 
faces) and M G (1)=M 425 (with 1000 faces), specified in a PM representation of the progressive mesh sequence shown 
in Fig. 24 and evaluated at a={0.0, 0.25, 0.50, 0.75, and 1.0}. 

Fig. 1 1 is a block diagram of a system according to the illustrated embodiment of the invention for progressively 
10 transmitting and displaying views of a three dimensional object based on the PM representation. 

Figs. 12(a-b) are flow charts of a transmitting method and a receiving method in the system of Fig. 1 1 for progres- 
sively transmitting and interactively displaying views based on the PM representation. 

Fig. 1 3 is a block diagram of a vertex split transformation specified in a PM representation and illustrating encoding 
of attributes in a vertex split record with predictive and delta encoding for mesh compression. 
is Hg. 14 is a flow chart of a method according to the illustrated embodiment of the invention for selective refinement 
of a mesh based on the PM representation of Fig. 7. 

Fig. 15 is a flow chart of an alternative method according to the illustrated embodiment of the invention for selective 
refinement of a mesh based on the PM representation of Fig. 7 and using a closest living ancestor condition. 

Figs. 16(a-b) are views of exemplary meshes produced by selective refinement within a view frustum according to 
so the methods of Figs. 14 (with 9,462 faces shown in Fig. 16(a)) and 15 (with 12,169 faces shown in Fig. 16(b)), respec- 
tively. 

Fig. 1 7 is a flow chart of a further modification of the methods of Figs. 1 3 and 1 4 for selective refinement of a mesh 
based on the PM representation of Fig. 7 which maintains more detail near silhouette edges and near the viewer. 

Figs. 18(a-b) are views of an exemplary mesh (with 7,438 faces) produced by selective refinement within a view 
25 frustum according to the method of Fig. 1 7. 

Fig. 19 is a flow chart of a mesh simplification method according to the illustrated embodiment of the invention for 
constructing the PM representation of an arbitrary mesh. 

Fig. 20 is a graph of accuracy versus conciseness illustrating the results of the mesh simplification method shown 
in Fig. 19. 

30 Figs, 21(a-c) are views of a simplified mesh (Figs. 21 (b-c)) produced from an exemplary arbitrary mesh (Figs. 21 (a) 
- a mesh with regular connectivity whose vertex colors correspond to the pixels of an image) according to the simplifi- 
cation method of Fig. 19 and illustrating preservation of a complex scalar attribute field (i.e., color). 

Figs. 22(a-c) are views of a simplified mesh (Figs. 22(b-c)) with 10,000 faces produced from an exemplary arbitrary 
mesh (Fig. 22(a)) with 150,983 faces according to the simplification method of Fig. 19 illustrating preservation of a sca- 

35 lar attribute (radiosity). 

Figs. 23(a<J) are views of a simplified mesh (Figs. 23(c-d)) with 3,000 faces produced from an original arbitrary 
mesh (Figs. 23(a-b)) with 19,458 faces according to the simplification method of Fig, 19 illustrating preservation of over- 
all appearance (including both geometry and attributes). 

Figs. 24(a-d) are views of three exemplary meshes (M° with 150 faces in Fig. 24(b); M 425 with 10|)0 faces in Fig. 
40 24(c); and M 1925 with 4000 faces Th Fig. 24(d)) out of a sequence of progressive meshes formed according to the sim- 
plification method of Fig. 19 from an example initial arbitrary mesh M with 13,546 faces (Fig. 24(a)). 

Figs. 25(a-c) are views of exemplary simplified meshes (each with 2000 faces) produced according to variations of 
the simplification method of Fig. 19 (Fig. 25(a) without E^; Fig. 25(b) with discontinuity curve topology fixed; and Fig. 
25(c) with Edjsc and with discontinuity curve topology changing) illustrating preservation of the geometry of discontinuity 
45 curves. 

Fig. 26 is a block diagram of a geomorph data structure for representing a geomorph between two meshes of the 
PM representation of Fig. 7 which is constructed according to the geomorph construction method of Fig. 9(a). 

DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS 

50 

Referring to Fig. 5, an operating environment for an illustrated embodiment of the present invention is a computer 
system 50 with a computer 52 that comprises at least one high speed processing unit (CPU) 54, in conjunction with a 
memory system 56, an input device 58, and an output device 60. These elements are interconnected by at least one 
bus structure 62. 

55 The illustrated CPU 54 is of familiar design and includes an ALU 64 for performing computations, a collection of 
registers 66 for temporary storage of data and instructions, and a control unit 68 for controlling operation of the system 
50. The CPU 54 may be a processor having any of a variety of architectures including Alpha from Digital, MIPS from 
MIPS Technology, NEC, IDT, Siemens, and others, x86 from Intel and others, including Cyrix, AMD, and Nexgen, and 
the PowerPC from IBM and Motorola. 
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The memory system 56 generally includes high-speed main memory 70 in the form of a medium such as random 
access memory (RAM) and read only memory (ROM) semiconductor devices, and secondary storage 72 in the form of 
long term storage mediums such as floppy disks, hard disks, tape, CD-ROM, flash memory, etc. and other dev.ces that 
store data using electrical, magnetic, optical or other recording media. The main memory 70 also can include video dis- 
play memory for displaying images through a display device. Those skilled in the art will recognize that the memory 56 
can comprise a variety of alternative components having a variety of storage capacities. 

The input and output devices 58, 60 also are familiar. The input device 58 can comprise a keyboard, a mouse, a 
physical transducer (e.g., a microphone), etc. The output device 60 can comprise a display, a printer, a transducer (e.g., 
a speaker), etc. Some devices, such as a network interface or a modem, can be used as input and/or output devices. 

As is familiar to those skilled in the art, the computer system 50 further includes an operating system and at least 
one application program. The operating system is the set of software which controls the computer system's operation 
and the allocation of resources. The application program is the set of software that performs a task desired by the user, 
using computer resources made available through the operating system. Both are resident in the illustrated memory 

system 56. " 

In accordance with the practices of persons skilled in the art ol computer programming, the present invention is 
described below with reference to acts and symbolic representations of operations that are performed by computer sys- 
tem 50, unless indicated otherwise. Such acts and operations are sometimes referred to as being computer-executed. 
It will be appreciated that the acts and symbolically represented operations include the manipulation by the CPU 54 of 
electrical signals representing data bits which causes a resulting transformation or reduction of the electrical signal rep- 
resentation, and the maintenance of data bits at memory locations in memory system 56 to thereby reconfigure or oth- 
erwise alter the computer system's operation, as well as other processing of signals. The memory locations where data 
bits are maintained are physical locations that have particular electrical, magnetic, or optical properties corresponding 
to the data bits. The term "specify" is sometimes used herein to refer to the act of encoding data bits as representations 
of physical objects, activities, properties or characteristics, and relationships. 

Overview of Meshes. 

Referring now to Fig. 6;ihe computer system 50 (Fig. 5) utilizes a progressive mesh ("PM") representation to model 
three dimensional objects for graphics imaging as polygonal meshes at varying levels of detail. For simplicity, the PM 
representation in the illustrated embodiment operates on triangle meshes (see, discussion in the "Background and 
Summary of the Invention" above). The PM representation of the illustrated embodiment can operate with more general 
meshes such as those containing n-sided faces and faces with holes, by first converting the more general mesh into a 
triangle mesh using conventional triangulation processes (e.g.. edges are added to subdivide polygonal faces of the 
mesh having more than 3 sides into triangle faces). Alternatively, edge collapse transformations (described below) can 
be applied to the sides of polygonal faces having more than three sides to produce a triangle mesh. It should also be 
recognized that the PM representation can be generalized in alternative embodiments of the invention to operate 
directly with more general meshes (i.e., without prior triangulation), at the expense of more complex data structures. 

Overview of Progressive Mesh Representation. — 

Referring again to Figs. 1 and 2, Hoppe93 (see, Background and Summary of the Invention above) describes a 
mesh optimization method that can be used to approximate an initial mesh M by a much simpler one. This mesh opti- 
mization method traverses the space of possible meshes (as discussed above with reference to the graph of Fig. 2) by 
successively applying a set of 3 mesh transformations: edge collapse, edge split, and edge swap. 

With reference to Fig. 6, the inventor has since discovered that in fact a single one of those transformations, edge 
collapse denoted herein as ecol({v s .Vt}) , is sufficient for the effective simplification of a mesh. To illustrate, an edge col- 
lapse transformation 1 10 unifies 2 adjacent vertices v s 86 and v t 89 of the mesh 80 into a single vertex v s 86' to form 
a resulting simpler mesh 1 1 2. The vertex v t 89 and the two adjacent faces {v s , v t , vj 1 00 and {v s , v t , vj 1 01 of the original 
mesh 80 vanish in the process. A position v s is specified for the new unified vertex 86'. 

Thus, an initial mesh M=M" can be simplified (such as by the mesh simplification method described more fully 
below) into a coarser mesh MP by applying a sequence of n successive edge collapse transformations: 

(M = M n )ecol n _ 1 -*M n '\.. ecol^ M 1 ecot 0 -> M° (5) 

The particular sequence of edge collapse transformations must be chosen carefully, since it determines the quality of 
the approximating meshes M, i<n. Where m 0 is the number of vertices in M°, the vertices of mesh /W are labeled 

herein as V^v, v m0+ J, so that vertex v m0 ^ is removed by ecol h As vertices may have different positions in the 

different meshes, the position of Vj in A/f is denoted herein as vj. 

A key observation is that an edge collapse transformation is invertible. The inverse transformation is herein referred 
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to as a vertex split 116. A vertex split transformation, denoted herein as vsplit(v s ,v h v n v t ,A) t adds near vertex v s 86* a 
new vertex (i.e., previously removed vertex v t 89) and two new faces (i.e., previously removed faces {v s ,v t ,vi} 100 and 
{v s y t > v ri 101 > according to the two side vertices v f 87 and v r 88. (If the edge {v 8t vj 92 is a boundary edge, then v r =0 
and only one face is added.) The transformation also updates the attributes of the mesh in the neighborhood of the 
5 transformation. This attribute information, denoted by A, includes the positions v s and v t of the two affected vertices, 
the discrete attributes d {vs vt vl} and d {vsvtvr} of the two new faces, and the scalar attributes of the affected corners 

(S( VS S(w,-)' S (vl t {vs t vt,vl)y and S (vr,{vs,vt>vr}))' 

Referring to Fig. 7, because edge collapse transformations are invertible, an arbitrary triangle mesh M therefore 
can be represented according to the illustrated embodiment of the invention as a data structure 130 containing a base 
w mesh record 132 specifying the simple mesh M° (hereafter the "base mesh"), together with a sequence 134 of n vsplit 
records 136 specifying a sequence of vertex split transformations that reconstruct the arbitrary mesh M from the base 
mesh M°: 



where the vsplit records are parameterized as vsplit^s h l h r h A^. The data structure (tvf,{vsp!it 0 ,...,vsptit n . 1 }) 130 is 
referred to herein as a progressive mesh (PM) representation of the arbitrary mesh M. 

A significant property (referred to herein as "completeness") of the vertex split transformation is that a mesh with 
any arbitrary simplicial complex K A can be constructed from a mesh with a minimal simplicial complex of the same 

20 topological type by a sequence of one or more of the transformations. (The four to one face spirt transformation used in 
the prior MR A approach discussed above is not complete in this sense because a sequence of these face split trans- 
formations can only construct an approximation to any arbitrary mesh from a minimal mesh of the same topological type 
having subdivision connectivity.) Because the vertex split transformation is complete in this sense, any arbitrary mesh 
can be reprented exactly using the illustrated PM representation. Similarly, a set of one or more mesh transformations 

25 also is complete if a mesh having any arbitrary simplicial complex K A can be constructed from a minimal simplicial com- 
plex of the same topological type by a sequence of transformations from the set. Accordingly, although vertex split 
transformations are specified in the sequence of records in the PM representation of the illustrated embodiment, the 
records in a PM representation can alternatively specify a set of mesh transformations that is complete other than the 
vertex split transformation. For example, a set including the 4-to-1 face split transformation plus a vertex split transfor- 

30 mation is complete and can be specified in the sequence of records in a PM representation of an alternative embodi- 
ment of the invention. 

In the PM representation 130 of the illustrated embodiment, the base mesh record 132 comprises a simplicial com- 
plex table 140, a vertex positions table 142, a discrete attributes table 144, and a scalar attributes table 146 which con- 
tain information of the tuple (vf=(K°, \/°,D 0 ,SP) that defines the base mesh Ivf. The vertex positions table 142 contains 

35 mo position records 150-151 for each vertex of the base mesh Ivf with that vertex's coordinate values (x,y,z). In the illus- 
trated vertex positions table 142, the position records 150-151 are indexed according to vertex indices associated with 
the indices of the base mesh Ivf. - ^ 

The simplicial complex table 1 40 contains face records 1 54-1 55 for each face in the base mesh Ivf with the indices 
of that face's vertices {Vj,v kt vfi. This vertex information in the face records explicitly defines each face of the base mesh 

40 Ivf, and also implicitly defines the edges and corners of the'base mesh Ivf. In alternative embodiments; the base mesh 
record 132 can contain information which explicitly defines the edges and corners, such as records containing indices 
of pairs of adjacent vertices to define the edges and records containing indices of vertex index; face index tuples to 
define the corners. In the illustrated simplicial complex table, the face records 154-155 are indexed according to face 
indices associated with the faces of the base mesh Ivf. 

45 The discrete attributes table 144 contains records 158-159 with information (i.e., an attribute value and a face 
index) that defines the discrete attributes associated with the faces of the base mesh Ivf. The scalar attributes table 
146 contains records 162-164 with information (i.e., an attribute value and a vertex index, face index tuple) that define 
scalar attributes associated with corners of the base mesh Ivf. Although illustrated with a single discrete attributes table 
144 and a single scalar attributes table 146, the base mesh record 132 can contain separate attributes tables for each 

so of multiple different discrete and scalar attributes (e.g., material identifies, shader function parameters, diffuse color, 
normal, texture coordinates, etc.) of the base mesh Ivf. 

The vertex split records 136 in the sequence 134 specify vertex split transformations that reconstruct the arbitrary 
original mesh M from the base mesh Ivf. In general, the information in each of the vertex split records comprises indi- 
ces of the vertices v 6 86, v t 87 and v r 88 (Fig. 6); the position coordinates v s n and v/ 1 of the vertices v s 86 and v t 89 

55 (Fig. 6); the discrete attributes d {vSiVt ^ } and d {vs%vttVr} of faces 100 and 101 (Fig. 6); and the scalar attributes s (vs 
S(vt,{vs,vt,vi}). and s (vrt{VSiVtiVr}) of the corners of the faces 100 and 101 . In alternative embodiments, the vertex split 
records can specify the vertices v s% v h and v r indirectly such as by the index of a neighboring face (e.g., one including 
the vertices v s and v f ) and bits identifying the vertexes from those adjacent that face (e.g., identifying v s and v f out of 
the face's vertices, and identifying v r out of the vertices neighboring the face). 



M° vsplit 0 -> M 1 vsplit^ ... vsplit,,.^ (M n =M) 



(6) 



15 



8 
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As an example with reference to Figs. 8(a-d). the example initial arbitrary mesh M of Fig. 1(a) (with 12*46 faces) 
was sfmp^ fdS-n to the coarse mesh M° 170 of Fig. 8(a) (with 50 faces) using f^S^^TZ^ 
The PM representation of M (Fig. 1(a)) consists of a base mesh record specifying M° together with a sequence of 
n-64^8 ^pT^TF^L pMr^resenXa^. one can extract approximating meshes with any des-red number 

5 oftcts Sin ±1 by applying to M° a prtf* of the vspiit sequence. For example, Figs. 8(b<i) shows two approx.mat.ng 
meshes with 200 and 1 000 faces out of the progressive meshes sequence. 

In the illustrated embodiment, the data structure of the PM representation 130 described above where the simptaal 
compix table 140 lists face records 154-155 containing the vertex indices of each face 't^**™*?^ 
(eq storage of the progressive meshes on the hard disk of the computer system 50 of F.g. 5). At run t.me. the illus 

10 SedtmoSiment utilSs an edge based data structure for the simplicia. complex table 1 40 to f™*"^** 
cency of faces. This allows for efficient processing of queries, such as which faces are adjacent to face £ and which 
faces a^e adjacent to vertex v. Suitable edge based data structures are well known, and include the w,nged-edge data 
s*uc^ > Stale* I in K. Wei.er. Edge-based Data Structures for Solid Modeiing in Curved-suriace Envronments, IEEE 

, 5 ^^ISS^SL^ of the invention, the vertex split records 136 can encode information to specify 
the a^biTs of the mesh both before and after the vertex split transformation is applied. Th.s allows traversal of the 

in both directions. In other words, a grven mesh in the P ra 9 ress ^ m ^ U ^^ 
belSfurther refin^by applying vertex split transformations specified in subsequent (J.J^^fi SSSJ 
records, or the mesh can be simplified by reversing the vertex split transformations speCed '" P^J^ 

20 aoSed vertex spirt records as desired. At a minimum, the added information specrf.es the vertex posrt.on v s .n the 
n^h before the Vertex sp.it transformation is applied. Other attributes of thefaces ^^^^SX « 
are present before the vertex split transformation is applied also can be encoded .n the vertex spirt records rf they are 
changed by the vertex split transformation. 

25 Geomorphs. 

A beneficial property of the vertex split transformation (and its inverse, edge collapse) is that a smooth visual tran- 
s• rt ion^ b aTeomo' SjSbS created between the two meshes and M i+1 in M 

the meshes contain no attributes other than vertex positions, the vertex split records 136 (Fig. 7) are each encoded as 



30 



vspiit ± (s Jt l if r it Ai= (v gi ltl fVno.i.S* 1 ) ) 



35 where s, L r, are the indices of the vertices v s , v„ and v ri> respectively. (In other words, the vertex split record 136 con- 
2n?£ vertex indices and position values, but not the discrete and scalar ^^X^£^M ^ 
morph uPfa) is created with Wend parameter 0 * a < 1 . such that HP(0) looks hke M and looks like M in 
fact M?(1 )=M ' +, -by defining a mesh 

„ " M G {aMK"\v G ( a )) W 

whose connectivity is that of and whose vertex positions linearly interpolate from v sje Mf to the split vertices 



45 



50 



55 



v G (a) = / (ot)v j i * 1 + (l-a)v Bi i , j e fs lf m 0 +i+l} 



(8) 



Using such geomorphs. an application can smoothly transition from a mesh M to meshes A* + ' or M' 1 without any 

viable "snaoDincf of the meshes, by varying the value of a. 

^SoSISni each MmJ vspleco, transformation can be transrtioned smoothly, so can the composer , of 
any sequence of them. Thus, given any two meshes, a coarser mesh and a finer mesh A/, Ojcj fz n. m the 
sSue^ce of meshes *f encoded by the PM representation, a smooth geomorph vP(a) can be def,ned such that 
Spooks SeV and 1^(1) equals M*. To obtain VP, each vertex , y of A/ is associated with rts ancestor r, ^ he 
index AW oi te ancestor verWis found by recursively backtracking through the vspiit transformations that led to the 



creation of v. 



r 



9 



EP 0 784 295 A2 



A c (j) = 



/ 



J 

A c 



m n +c 



(9) 



(In practice, this ancestor information A c is gathered in a forward fashion as the mesh is refined.) The geomorph tVP(a) 
is defined by tvPfaMK 1 , v°(a)) to have the connectivity of M 1 and the vertex positions 

Vj G (a) = (ot) Vj f + (l-a)v Aclj) c {10) 



So far the above discussion has outlined the construction of geomorphs between PM meshes containing only posi- 
tion attributes In fact geomorphs can be constructed for meshes containing both discrete and scalar attributes. 

Discrete attributes by their nature cannot be smoothly interpolated. Fortunately, these discrete attributes are asso- 
ciated with faces of the mesh, and the "geometric" geomorphs described above smoothly introduce faces. In particular, 
observe that the faces of ^ are a proper subset of the faces of /W. and that those faces of W rn.ss.ng from M= are 
invisible in 1^(0) because they have been collapsed to degenerate (zero area) triangles Thus, as a is varied from 0 to 
1 these triangles grow from zero area triangles in Vp(0) to their full size in l^(1)=lrf. Prior geomorph.ng schemes 
(such as those described in J. M. Lounsbery. Multiresolution Analysis for Surfaces of Arbitrary Topologtcal Type PhD 
thesis. Department of Computer Science and Engineering. University of Washington. (1994); Lounsbery-etal94; and 
Turk92} define well-behaved (invertiWe) parametrizations between meshes at different levels-of-detail. Such parametn- 
zations do not permit the construction of geomorphs between meshes with different discrete attributes. In contrast, geo- 
morphs of the PM representation meshes define non-invertible maps from Nf to NF. in which all faces of M missing 
from WF are mapped to edges or vertices of UF. This mapping makes a smooth visual transition of meshes with discrete 

^''scater'aStoutes defined on corners also can be smoothly interpolated much like the vertex positions. There is a 
slight complication in that a corner (v.f) present in a mesh M cannot be associated with any "ancestor comer in a 
coarser mesh b/F A f \s not a face of h/F. The attribute value that the corner (v,f) would have in HF can be inferred by 
examining the mesh M+ 1 in which / is first introduced, locating a neighboring corner (v.f) in A^ +I whose attribute value 
is the same, and recursively backtracking from it to a corner in WF. If there is no neighboring corner in M with an iden- 
tical attribute value, then the corner (v.f) has no equivalent in M° and its attribute.is therefore kept constant through the 

9e °The interpolating function on the scalar attributes need not be linear; for instance, normals are best interpolated 
over the unit sphere, and colors may be best interpolated in Hue-Saturation-Value ("HSV") space (although, in the illus- 
trated embodiment, colors are interpolated in Red-Green-Blue ("RGB") space for efficiency). 

The interpolating function for vertex positions also need not be linear. In sop embodiments of the invention for 
example, the vertex positions of the geomorph can be def ined as ~ 

V s (a) = (a (a) ) v*+ (1 -a (a) ) v c , 

where the function a(a)=0.5 + 0.5sin((*-0.5)n) (i.e.. a non-linear function in a as opposed to a linear function such 
as afa;=a;. This non-linear function a(a) provides interpolation for 0<as1. but has a zero valued derivatve atO and 1. 
This results in a slow-in, slow-out interpolation behavior. 

Referring to Fig. 9(a). the illustrated computer system 50 (Fig. 5) performs a method 190 for constructing geo- 
morphs to display smooth transitions between any two progressive meshes in a PM representation. The method 190 
can be implemented as a module of code, which for example forms a component of a software application run on the 
computer system 50 to display 3D graphics. The method 1 90 generally is a preprocess for the geomorph evaluation and 
display method shown in Fig. 9(b). F 

The method 190 begins at steps 192-193 with selecting the coarser mesh A/r and finer mesh out of successive 
level of detail meshes specified in a PM representation. This selection can be made by the software application rtseH. 
For example, when transitioning between level-of-detail approximations due to a change in viewing distance the soft- 
ware application selects the coarser and finer meshes to correspond to the starting and ending level-of-detail approxi- 
mations Alternatively, the software application can provide user interface controls (e.g.. a value entry box, or a list 
selection box) for selection of the coarser and finer meshes by the computer user. Fig. 3. described below, illustrates a 
software system with user interface controls for selecting the coarser and finer meshes. 
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to the corresponding faces of the geomorph. 

M7 r£r,r;S^ 

„, C^SrC^S^^ «» ■«»n* « "-y S3T- 

the line and coarse meshes according to Hie Mend parameter o. the vertex posfon records 208-209 encode these ve. 

tax positions in the line and coarse meshes, pf.yf.zf) (*i JJ ■*!>■ . whi ,„ r e~esent the 

™. rti«-r«t« .nribules table 204 and the scalar attributes table 205 compnse records 2 10-21 3 wnicn represem rra 
scala^erS dSeB SSe «lui ol .he fee and corners of the geomcph. respects* The scalar attribute re™* 
S^crten^oTtT scalar attribute values <sf) and ft/j ol the cornerslrom bc« the coarse and line meshes, for 

"TeSr^^ 

seleS2 at steps 192. 193 of the method 190 (Fig. 9(a)). The method 200 thus repeats a loop of steps for each value 

° f T^SS^had 200. the value of the blend parameter a is selected. Again. ^^^^ 
the software application or by the computer user. In the case of the software appl.cat.on e .s generally stepped through 
TJwZL of values that smoothly transition the geomorph between the coarser and f .ner meshes 
I wXn 0 in the example geomorph shown in Fkjs. 10(a-D). For selection by the compute, -user, •"J**" *J . 

""rr^oTsefa^ 

s^lo then regenerates and displays a view based on the geomorph at step 205. As ,nd,cated at step 206. the 
•rfpns 202-205 are then repeated for other selected values of the Wend parameter a. „• „ =„, ,«. 

S itSSSEXJS 1 «— * ,e,e, o, detti, o. . mesh output by the MM 
426 Thegraphics.pplication424anddisplaydriver«^^ 

Fo, seMno the level ol detail of the mesh, the user interlace 422 comprises two user interlace controls. a"» 
™^ 4^^^T sMer control 434 The slider controls 432. 434 preferably are implemented as elrtno use interlace 
SloL "sucfas a Srd S W atttrnativel, may be implemented as other user interlace controls which alio. . selec- 
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trol. In some alternative embodiments of the invention, the T slide control 434 can be omitted and the values ot the set 

of geomorph complexity variables T 0 T g+ , set by the graphics application 424. 

The output variables D and T 0 T^, are in turn passed by the graphics application 424 to the level of detail 

approximator 426. In the level of detail approximator, the geomorph complexity variables T 0 T g+1 determine the com- 
plexities of a set of coarse and fine meshes out of the progressive meshes in a PM representation from which a set of 
geomorphs G° G 9 is constructed. The detail variable D selects a geomorph out of the set of geomorphs and the 
value of the blend parameter at which to evaluate the geomorph to produce an approximation of the mesh at a desired 

level of detail. . ,„„ . 

The level of detail approximator 426 comprises an interpolator 436, a PM representation block 438, and a geo- 
morphs table 440 The interpolator 436 converts the value of the detail variable D to an index j for a geomorph G out 

of the set of geomorphs G° & and to a value of the blend parameter a. For example, where there are 10 geomorphs 

in the set G° G 9 the interpolator 436 can allocate the range of the detail variable D between 0.0 and 0. 1 to the first 
geomorph G° and' calculate the blend parameter for that geomorph as a=70D. Similarly, the range between 0.1 and 
0 2 is allocated to the second geomorph G 1 , and the blend parameter for that geomorph calculated as a= 10(D-0. 1). 
etc The interpolator 436 can be implemented as a block of code which calculates a linear interpolation of the detail var- 
iable D to a selected geomorph Q and blend parameter a. Alternatively, the interpolator 436 is implemented as a look 
up table which maps the detail variable D to the selected geomorph G and blend parameter a. 

The PM representation block 438 is a PM representation data structure, such as the data structure 130 shown in 
Fig 7 of the mesh being approximated. The geomorphs table 440 is an ordered list of geomorph blocks 441-443 for 

the geomorphs G° &. Each of the geomorph blocks 441-443 is a geomorph data structure suchas the geomorph 

data structure 200 shown in Fig. 26. The level of detail approximator constructs the geomorphs G" GP stored as 

blocks 441-443 from the PM representation stored as block 438 according to the geomorph construction method 190 
of Fig 9(a) For each of the geomorphs G, the values of the geomorph complexity variables V and V* specify the 
coarse and fine meshes M T i and M T >+ 1 out of the progressive meshes specified in the PM representation from which 
the geomorph is constructed. For example, the geomorph complexity variables T° and T' specify the coarse and fine 

mesh M T ° and M T1 for the geomorph G° out of the progressive meshes M° MP specified in the PM representation. 

In the illustrated system 420. the geomorph complexity variables T 0 T g+ , specify the number 0 n of the mesh in 

the progressive meshes sequence /M° . Alternatively, the geomorph complexity variables T 0 7 g+ , can specify 

the number of faces or number of vertices of the fine and coarse meshes of the set of geomorphs (in which case the T 
slider control 434 has a range from a minimum to a maximum number of the faces or vertices in the PM representation). 

After constructing the set of geomorphs respresented in the geomorphs table 440 based on the geomorph com- 
plexity variables T 0 7 0+f . the level of detail approximator 426 evaluates the geomorph according to the geomorph 
evaluation method 220 (Fig. 9(b)) based on the interpolated values for desired geomorph G and blend parameter a. 
This produces approximation of the mesh at a desired level of detail which the level of detail approximator 426 outputs 
to the graphics application 424. The graphics application 424 then renders an image of the approximating mesh using 
conventional mesh rendering techniques, and outputs the image to the display driver 428 for display on an output device 
60 of the computer system 50 (Fig.. 5). " " 

Progressive transmission. i 

With reference to Fig. 1 1 . a system 230 according to the illustrated embodiment of the invention utilizes the PM rep- 
resentation for progressive transmission of three dimensional graphics models at multiple levels-of -detail. The system 
230 comprises a transmitting computer 232 such as (a network or file server) and a receiving computer 233 such as (a 
client computer station or terminal) which are linked via a communications link 234. These computers 232-233 have the 
architecture of the computer system 50 shown in Fig. 5. The communications link 234 in the illustrated progressive 
transmission system 230 comprises modems 236-237 and a telephone line 238, but alternatively can be realized as a 
local or wide area computer network (including public and private switched networks, commercial online services, the 
internet and the like), a broadcast data network, an infra-red or radio frequency link or other communications technolo- 
gies The transmitting computer 232 stores a PM representation of an arbitrary mesh M in a database 240 of three 
dimensional models, and runs a progressive transmission software application that implements a transmitting process 
244 (Fig 12(a)) for transmitting a PM representation in the database 240 to the receiving computer 233 on the commu- 
nications link 234. The receiving computer 233 runs a progressive transmission software application that implements a 
receiving process 246 (Fig. 12(b)) for receiving the PM representation from the communications link 234 and rendering 
views of the mesh at progressively finer levels of detail. 

Referring now to Fig. 12(a). according to the progressive transmission method 244, the transmitting computer 232 
(Fig 1 1) first transmits the base mesh M° of the PM representation (e g., as the base mesh record 132 of Fig. 7 or as 
a conventional uni-resolution format), followed by the stream 134 (Fig. 7) of the vertex split vsplit, records 136 (Fig. 7). 

Referring to Fig 1 2(b), the receiving process 246 incrementally rebuilds the arbitrary mesh M specified by the PM 
representation as the vertex split records arrive, and animates the view of the changing mesh. In the illustrate receiving 
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process 246, the changes to the mesh are geomorphed to avoid visual discontinuities. The original mesh M is recov- 
ered exactly after all n vertex split records in the PM representation are received, since PM is a lossless representation. 

At step 254 of the illustrated receiving process 246, the receiving computer 233 (Fig. 11) first receives the base 
mesh MP record 132 (Fig. 7) transmitted from the transmitting computer 232 (Fig. 1 1) at step 250 of process 244. The 
receiving computer 233 then constructs and displays a view of the base mesh at step 255. 

Next, in a loop of steps 256-259, the receiving computer 232 incrementally reconstructs the mesh M and interac- 
tively displays a view of the mesh. At step 256 in each iteration of the loop, the receiving computer 233 receives a next 
group of vsplit records 136 (Fig. 7) transmitted from the transmitting computer 232 at step 251 of process 244. Since 
the transmitting computer 232 transmits the vsplit records continuously, the receiving computer 233 of the illustrated 
embodiment includes an input buffer which temporarily stores vertex split records transmitted during the constructing 
and displaying steps 255, 257-258 until the receiving computer is ready to process them. 

At step 257, the receiving computer 233 incrementally refines the mesh to a current incremental mesh by applying 
the group of vsplit records received at step 256 to a previous incremental mesh. In the first iteration of the loop, the pre- 
vious incremental mesh is the base mesh from step 255. In subsequent iterations of the loop, the previous incremental 
mesh is the current incremental mesh from the previous iteration of the loop. At step 258, the receiving computer 233 
then constructs a geomorph from the previous incremental mesh to the current incremental mesh, and displays a visu- 
ally smooth transition between the incremental meshes using the geomorph. The step 258 can optionally be omitted, 
and the mesh constructed at step 257 instead displayed. 

The receiving process preferably balances computation between the progressive reconstruction of the mesh M and 
interactive display by varying the number of vertex split records received at the step 256 in each iteration of the loop 
256-259. In the presence of a slow communication line, a simple strategy is to display the current mesh whenever the 
input buffer is found to be empty (i.e., vsplit records are continuously applied at step 257 until the input buffer is 
exhausted, then the geomorph is constructed and displayed as the input buffer is replenished before repeating in a next 
iteration of the loop). For a fast communication line (i.e., where transmission of the vsplit record stream 134 (Fig. 7) 
takes less time then constructing and displaying geomorphs from the base mesh to more than one incremental mesh 
out of the progressive mesh sequence), an alternative strategy is to display meshes whose complexities increase expo- 
nentially (i.e.. a number p of vsplit records received at step 256 in each iteration of the loop increases exponentially). 
For fast communication lines, the step 258 of constructing and displaying a geomorph from the preceding mesh is sub- 
stituted with displaying the mesh from step 257. 

Mesh compression. 

The PM representation of the illustrated embodiment also provides a space-efficient representation for storing 
meshes. The PM representation encodes not only the initial mesh M, but also a continuous resolution family of meshes, 
in a space competitive with that of a compressed uni-resolution mesh. First, the size of the PM representation is linear 
on the size of the initial mesh h/P since the number n of vsplit records is less than the number m 0 +n of vertices in MP. 
More importantly, because a vertex split is a local transformation on the surface, one can expect significant coherence 
in surface attributes before and after each transformation. The PM representation of the illustrated embodiment takes 
advantageof this coherence by encoding the vertex split records with predictive and delta encoding schemes. 

In particular, with reference to Fig. 12, the vertex positions vj+ 1 (i.e., the position of vertex 272) and v m0+/+7 ' + ('■©•. 
the position of vertex 273) can be predicted from vj (i.e. , the position of vertex 270) in each vertex split vsplitj transfor- 
mation 276 between mesh M 278 and mesh /W + * 279. That is, the positions of vertices 272-273 is expected to be near 
the position of vertex 270. Thus, the illustrated computer system 50 (Fig. 5) encodes the vertex positions in each vspliU 
record 136 (Fig. 7) as the difference or delta from the vertex position vj (i.e.. 

Aj-fv.^-v., 1 , v m0+i .r 2 -v 3 /)) , 

which requires fewer bits to encode for a given precision than the full coordinates (x,y,z) of vertex positions v fi / +/ and 
v m0+i+ /+ * . Preferably, these position differences or deltas are encoded in the vertex split records with a variable length 
delta encoding scheme, e.g., variable length Huffman codes. Suitable variable length codes including Huffman codes 
are described in M. Deering, Geometry Compression, 1995 Computer Graphics Proceedings 13-20 [hereafter "Deer- 

In the illustrated embodiment, the number of bits needed to delta encode the vertex positions is further reduced by 
exploiting a property of the mesh simplification method (Fig. 19) that for the collapse of each edge {vj* .v m0 +i+i) 92 
(Fig. 6), the method considers three starting points for the vertex vj 86* in the resulting mesh: namely, 
/v s / +7 , Vmo+i+^vJ^+Vmo+i+i)^}. Depending on the starting point chosen by the method, the positions {vj+ , v m0 +i+i} 
aredeltMncoded as either position deltas {vj +1 -v s /,v m0 +i+rv s /} for starting positions v s / +? or v m0 ^ h or as position 
deltas {((vj + 1 +v m0 ^ ,)/2)-vJ % (v s r 1 -v m0+i+ for starting position (vj + U v m0+i + J/2. The vertex split records there- 
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fore encode the choice of the starting position, then the appropriate pair of position deltas. Since each of the four posi- 
tion delta tend to have different value ranges, the four position deltas preferably are encoded with separate Huffman 
code tables adjusted to those value ranges. 

In a further alternative PM representation, the construction algorithm can simply select 
Vsh{v s r\v m0+i+h (v s r 1 +v m0+i + 1 )/2}. This degrades the accuracy of the simplified base mesh, but allows the posi- 
tions {Vsl* 1 t v m0+i+ \} to be encoded with even fewer bits in the vertex split records (e.g., the choice of the position v s / 
out of the set of positions {v s r\v m0+ i +h (v si i+1 +v m0 + i+1 )/2} and then either the position delta v m0+/+r v s /for 

V 32 V SI * 



or the position delta vj + 1 -vJ for 



or the position delta (v si i+1 -v m0+i+1 )/2 for 

v s /=fv si i+I + v m0+i+a ;/2) . 

Further, since only a small set of vertices 282-287 is adjacent to the vertex v si 270 in the mesh M 278, a small 
number of bits can be used to specify the vertices v u 282 and v„ 283 out of the vertices 282-287 adjacent to vertex v si 
270 Rather than encode indices (hereafter "full vertex tndices")„of vertices v fi 282 and v ri 283 in the vsplit, record 136 
(Fig. 7) to uniquely distinguish them out of the set of all m 0 +n vertices in the original mesh /W° (which requires more 
bits) the illustrated computer system 50 encodes indices (hereafter "adjacent vertex indices") in the vspliU record 136 
indicating which out of the set of adjacent vertices 282-287 are the vertices v s 282 and v ri 283 (such as assigning adja- 
cent vertex indices to the adjacent vertices in ascending order of their full vertex indices). For the illustrated vertex split 
transformation 276 t the vertices v B 282 and v„ 283 can then be encoded in 3 bits each (which is sufficient to uniquely 
specify the vertices out of the six possible adjacent vertices). By contrast, even a simple mesh Af with 1 ,000 vertices 
requires at least 10 bit full vertex indices to uniquely specify each vertex of the mesh. 

Additionally, the discrete attributes (e.g., material identifiers) d {VStVtiVi} and d {VStVttVr} of the faces 290-291 introduced 
by the vsp//Y, transformation 276 in mesh Mt+ 1 279 can often be predicted from that of adjacent faces 294-297 in Af 278 
using only a few control bits. In the illustrated embodiment, for example, the control bits 00, 01 , and 1 1 indicate that the 
discrete attributes of a newly introduced face is either equal to that of the adjoining face (e.g., faces 294, 296) having 
v/ + 1 as a vertex, equal to that of the adjoining face (e.g., faces 295. 297) having v s i+1 as a vertex, or different from both 
adjoining faces. When the discrete attribute of a newly introduced face is equal to that of an adjoining face, the control 
bits 00 or 01 suffice to specify that discrete attribute. Where the discrete attribute is different from that of both adjoining 
faces the control bits 1 1 are followed by a value fully specifying the discrete attribute. Thus, in most cases, the vsplttj 
record 136 can encode the discrete attributes such as the material identif ier of the newly introduced faces in only two 

bits each. . - . 

Scalar attributes of newly introduced corners 301-304 in M +1 279 can similarly be predicted from neighboring cor- 
ners 305-308 in M 279. Thus, in the illustrated embodiment, these scalar attributes also can be encoded using one or 
more control bits to indicate equality with a neighboring corner or a different scalar attribute. For example, in the illus- 
trate embodiment, a scalar attribute associated with the newly introduced corner 301 is encoded in the vsp//f, record 
136 (Fig. 7) with a control bit 0 to indicate the scalar attribute is equal to that of the neighboring corner 306. Whereas, 
encoding with a control bit 1 followed by the value of the scalar attribute indicates a different scalar attribute. Preferably, 
in this latter case, the value is encoded by a variable length delta encoding as the difference from the scalar attribute of 
the neighboring corner 306 (which in at least some cases save some additional bits). 

As a result of the above encoding scheme of the illustrated embodiment, the size of a carefully designed PM rep- 
resentation should be at least competitive with that obtained from other prior methods for compressing uni-resolution 
meshes. 

Selective refinement. 

With reference to Figs. 1 3-17, the PM representation 130 (Fig. 7) of the illustrated embodiment also supports selec- 
tive refinement, whereby detail is added to the model only in desired areas. In general, the illustrated embodiment of 
the invention performs selective refinement by selectively applying only a subset of the vertex split transformations 
specified in the PM representation that refine the mesh in desired areas, such as the surface of the mesh within a view 



14 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



EP 0 784 295 A2 

frustum (i.e., the portion of the mesh that is within a view of the mesh currently being displayed). 

Referring now to Fig 14, a first selective refinement method 320 utilizes a callback function, REFINE(v). to deter- 
mine which vertex split transformations in the PM representation to apply in selectively refining an initial coarse mesh 
tJp The REFINE(v) function returns a Boolean value indicating whether the neighborhood of the mesh about v should 
be further refined As an example, to obtain selective refinement of the mesh within a view frustum (i.e., the portion of 
the mesh within a currently displayed view of the mesh), the REFINE(v) function is defined to be true if either v (e.g 
vertex vj 270 of Fig. 12) or any of its neighboring vertices (e.g. vertices 282-287 of Fig. 12) lies within the frustum. In 
the illustrated embodiment, the REFINE(v) function is supplied by a software application which interactively displays 

views of the mesh. ..... . . *c -,u „ 1 

The first selective refinement method 320 begins at step 322 by constructing an initial mesh /W, with 0<C<n-h 

out of the sequence of progressive meshes, M° NT. specified by the PM representation 130 (Fig. 7). The initial mesh 

yp is constructed by applying the vertex split records vsptt, 1 36 (Fig. 7). for all i<C if any. to the base mesh M>. 
The first selective refinement method 320 then comprises a loop of steps 323-237. In the loop, the process 320 

selectively refines the initial mesh M= by iterating through the remaining vertex split records {vsplit c vsplit^} 136 as 

before but only performing the vsplit,(s h l h r ir A) transformation at step 326 if: (1) all three vertices frrf.'W are P resent 
in the mesh (step 324). and (2) REFINE( v si ) evaluates to TRUE (step 325). (A vertex Vj is absent from the mesh at step 
324 if the prior vertex split that would have introduced it, vs P iitj. m0 .i. was not performed due to the above conditions of 

steps 324-325.) . , .. . 

After the loop 323-327 is repeated for all the vertex split records vsptt, 136. Cs/<n, the mesh has been selectively 
refined such that additional detail is added to the initial mesh M° in areas where more detail is desired (e.g.. within the 
view frustum) while other areas remain coarse. At step 328. the process can then display a view of the selectively 
refined mesh. As needed to avoid the popping effect, the process 320 can construct and display geomorphs (e.g.. using 
process 190 of Fig 9) between the initial mesh Np and the selectively refined mesh. 

With reference to Fig. 16(a). a first example mesh modeling a three dimensional terrain and selectively refined by 
the method 320 (Fig 14) has additional detail within a view frustum currently being displayed by the software applica- 
tion running on the computer system 50 (Fig. 5). For ease of illustration, only the first 10.000 (out of 33.844) vertex split 
transformations in the PM representation of the terrain model were considered for selective refinement (to keep the 
mesh from becoming too dense to be perceptible). 

Referring to Fig 15. a modified selective refinement method 320' permits more vertex split transformations to be 
applied near the boundaries of the localized area. A drawback of the method 320 (Fig. 14) is that a vertex within the 
view frustum 332 (Figs. 1 6{a-b)) may fail to be split because its expected neighbor v„ or v ri lies just outs.de the frustum 
and was not previously created. This is remedied in the modified method 320' by using a less stringent version of the 
condition in step 324 (Fig. 14). In a modified condition of step 324'. the closest living ancestor of a vertex Vj is defined 
to be the vertex with index 

A* (j) - I - j, if. v i exists in the mesh '- _ 

/ ' A' (Sj.no.j) , otherwise 

The modified condition of step 324' is that: ' A(sj-s, (i.e., v si is present in the mesh), and the vertices y^ ^ andj^ 
are both adjacent to v si in the mesh. As when constructing the geomorphs. the ancestor information A is carried effi- 
ciently as the vsplit records are parsed in the illustrated embodiment. If the conditions of both steps 324' and 325 are 
satisfied. vsplit(s i .A'(l i ).A , (r i ),Ai) «* aPP"«i to the mesh at step 326 as in the method 320 (Fig. 14). The remaining steps 
322. 323, 327 and 328 in the modified selective refinement method 320' are the same as in the first selective refinement 
rnsthoci 320 

Fig 16(b) demonstrates a second example selectively refined mesh which has been selectively refined by the mod- 
ified method 320' (Fig. 15) from the same PM representation of a terrain model as the first example selectively refined 
mesh 330 of Fig 16(a). Again, for convenience of illustration, only the f irst 10.000 vertex split transformations (out of 
33 844 vertex split transformations) of the PM representation were considered by the selective refinement method. 

Since the more lenient closest ancestor condition of step 324' allows more of the vertex split records {vspl^ vspht n . 

W 136 to be applied, the second example selectively refined mesh has much more detail within the v.ew frustum than 
the first example selectively refined mesh (i.e., 12,169 faces in the second example mesh shown in Fig. 16(b) versus 
9,462 faces in the first example mesh shown in Fig. 16(a)). 

Referring to Fig 17, a further drawback to the selective refinement methods 320 and 320 described above is that 
the above-described REFINE(v) function can still add a lot of detail to the selectively refined meshes shown in Figs^ 
16(a-b) that have little or no effect on the currently displayed view of the mesh. For example, the above-described 
REFINE(v) function yields a true result for vertex split transformation on a vertex v s within the view frustum, but far from 
the viewer Such details add little to the displayed view, but add significantly to the rendering time of the vjew. Substitut- 
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ing a modified REFINE(v) method 340 improves the above described selective refinement methods 320 and 320' by 
concentrating refinement near silhouette edges and near the viewer. 

•n a first step 342 of the modified REFINE(v) method 340, the method 340 calculates a signed projected screen 
area {af f e F v ] of each of the laces F v adjacent to the vertex v (i.e., the area taken by the face in the currently displayed 

5 view). The modified REFINE( v) method 340 then evaluates to or returns the Boolean value true at step 346 (i.e.. to step 
325 of the selective refinement methods 320 or 320'), if: (1) any 1ace f e F v lies within the view frustum (step 343), and 
either (2a) the signs of the projected display areas a f of the faces are not all equal (indicating that v lies near a silhouette 
edge) (step 344) or (2b) the sum of the projected screen areas is greater than a predetermined screen area 

threshold (e.g., 0.16 2 units where the image has unit area). Otherwise the modified REFINER) method 340 returns 

jo false at step 347 (to step 325 of the selective refinement methods 320 or 320'). 

Referring to Figs. 18(a-b), a third example selectively refined mesh (shown in Figs. 18(a-b)) is produced by the 
selective refinement method 320' with the modified REFINE(v) method 340 from the same PM representation of a ter- 
rain model as the first and second example meshes shown in Figs. 16(a-b). All 33,844 vertex split transformations were 
considered by this modified selective refinement method in this third example. Despite considering many more vertex 

is split transformations, the third example mesh (Figs. 18(a-b)) has far fewer faces (i.e., 7,438 faces) than both the first 
and second example meshes (i.e., 9,462 and 12,169 faces) (Figs. 16(a-b)) t while providing refinement of visually sig- 
nificant details (i.e., those within the view frustum, near silhouette regions, and near the viewer) substantially equal to 
that of the second example mesh (Fig. 16(b)). As can be seen by the overhead view of the third example selectively 
refined mesh shown in Fig. 18(b), with the REFINE(v) method 340 (which takes into account the view frustum, silhou- 

20 ette regions and screen size of faces), the selective refinement process 320' saves complexity of the resulting selec- 
tively refined mesh by avoiding refinement in areas within the view frustum that do not contribute significantly to the view 
being displayed. 

A further alternative selective refinement method is one that takes into account the visibility of the PM representa- 
tion's vertex split transformations. Although the vertex of a vertex split transformation lies within the view frustum, it may 

25 still not be currently visible to the viewer if occluded or positioned behind another portion of the surface or a different 
object entirely. For example, vertices on the far side of a ridge on the terrain model are not visible to the viewer, even if 
they are within the view frustum. For this alternative selective refinement method, the REFINE(v) function is further 
modified to return a negative or false result if the vertex is not visible. This results in an even simpler selectively refined 
mesh with a substantially equal quality of appearance in its currently visible areas. 

30 The above described selective refinement methods 320, 320* and 340 also can be beneficially applied to efficiently 
transmitting view-dependent models over low-bandwidth communication lines. As the receiver's view changes over 
time, the transmitting process (e.g., such as the transmitting process 244 of Fig. 12(a)) utilizes the above described 
selective refinement conditions (e.g., steps 324 or 324* along with step 325 or step 325 as modified by method 340) to 
select and transmit only vertex split transformation records vsp/tf, 136 within a currently viewed area of the mesh. As 

35 the view changes, the transmitting process further transmits any not yet sent vertex split records 136 for the changed 
view. Specifically, at each time frame, the transmitting process need only transmit those vertex split transformation 
records for whicHtthe REFINE( v) method evaluates to true and which were not transmitted in earlier time frames. 

Constructing the PM representation. ^ - 

40 - ■ ~ 

With reference to Fig. 19, a mesh simplification and PM construction method 380 constructs the PM representation 
130 (Fig. 7) of an arbitrary mesh M by first selecting a sequence of edge collapses that transform M=b/T into a simplified 
base mesh M°. A sequence of vertex split transformations that is the inverse of the selected edge collapses is then 
encoded with the base mesh M° as a PM representation of the arbitrary mesh M. The quality of the intermediate 
45 approximations or progressive meshes M, i<n specified by the resulting PM representation depends largely on appro- 
priately selecting which edges to collapse and what attributes to assign to the affected neighborhoods (e.g., the vertex 
positions Vgf). 

For use in appropriately selecting the edge collapse transformations in the illustrated PM construction method 380, 
an explicit energy metric E(M) is defined to measure the accuracy of simplified meshes M=(K, V,D,S) with respect to 
so the original mesh M. This energy metric has the following form: 

E(M) = E dist (M) + E^M) + E scatar (M) + E disc (M) (12) 

The first two terms. E dist (M) and E^^fM) are identical to terms of an energy metric for geometry preservation 
55 used in the mesh optimization method described in Hoppe93. The next two terms, E scafar (M) and E disc (M), of E(M) pre- 
serve attributes associated with M other than geometry alone. As described more fully below, the term E scelar (M) meas- 
ures the accuracy of the scalar attributes of the simplified mesh M, while the term E disc (M) measures the geometric 
accuracy of the discontinuity curves (defined below and illustrated with yellow lines in Figs. 8(a-c), 10(a-e), 23 (a.d), 
24(a-d) and 25(a-c)) of the simplified mesh M. 
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The PM construction method 380 performs mesh simplification by modifying the mesh M starting from M while min- 
imizing the energy metric, E(M). More specifically, the method applies minimization of the energy metnc to select suc- 
cessive modifications, i.e.. edge collapse transformations, to simplify the mesh to a base mesh M whrie best 
prS^me mesh's appearance. The base mesh M» together with a sequence of vertex sp. ItrnbrnM which 
fs The inverse of the simplifying succession of edge collapse transformations becomes the PM represented of the 
original mesh M. 

The method 380 begins at step 382 with calculating an estimated energy cost AE according to the energy metric 
E(M) of a set of all candidate edge collapse transformations. Edge collapse transformations of the edges of the mesh 
M must meet some local conditions to be included in the set of candidate edge collapse transformations. In the irt us- 
trated method 380 these local conditions include a maximum dihedral angle restriction and a manrfold preservation 
restriction as described in Hoppe93. The maximum dihedral angle restriction disallows any edge collapse 
tion if the maximum dihedral angle of edges in the neighborhood after an edge collapse exceeds a !, 
acos(-1/3)=109 471 degrees in the illustrate method), so as to avoid surface self-.ntersect.ons. For each candidate 
edge collapse K-* K\ the method 380 calculates its cost AE = E K - - E K by solving a continuous optimization 



E K . = min v s E dlsl (V) + E ^(V) + E BCalar (V,S) + E disc (V) 



(13) 



over both the vertex positions V and the scalar attributes S of the mesh w.th connectivity K\ _„ Hinn 
At step 383. the candidate edge collapse transformations are then organized into a pr.orrty queue .n ascending 
order of their estimated energy cost AE (i.e.. the edge collapse transformation with the lowest estimated energy cost 
AE is placed first in order of priority in the priority queue). >~*^****^ 
The method 380 simplifies the mesh M into the base mesh M° having a resolution or level o detail selected at step 
384. i.e. to within ±1 of a selected number of faces for the base mesh tJP . This number can be selected by 
user using a user interface control (e g., a numeral entry box. scro.l bar or like sliding control etc.) which is provided by 
the software application implementing the method 380. Alternatively, the software appl.cat.on can set the number o 
faces. In the illustrated method 380. the selected number of faces cannot be less than a mmimum number of faces for 
meshes of the same topological type as the original arbitrary mesh M. ^ 

The method 380 then repeats a loop of steps 385-389 until the mesh has been s.mplrf.ed to the number of faces 
selected in step 384 or there are no more candidate edge collapses. In each iterafcon of the loop. ^ 
aoolies the highest priority edge collapse transformation (ecol({v s . v})) in the priority queue to the mesh M a step 385. 
A^ ep386 ^L Lmod 380 stores £e vertex split transforma^ 

Xse Snsformation performed at step 385. (The set of the vertex spirt transformations ^**^™^} er 
encSed in reverse order at step 390 as the sequence of vertex spirt records 1 34 (F,g. 7) in 

At step 387 the method 380 compares the number of faces in the mesh M resulting from the edge collapse trans- 
formation to the number of faces selected for the base mesh VP. As long as the number of faces inM .s greater than 
he selSted nurnber of faces of the base mesh M° and there remain candidate edge collapse transformations .n the 
pnorityTuSe tnTmethod 380 continues iterating through the loop of steps 385-389. Otherwise, the method 380 exits 

'^ntinuing another iteration of the loop, the method 380 at step 388 recalculates the energy* «>^E of an candi- 
date edge collapse transformations in the neighborhood of the edge collapse transformation performed at step 385 .n 
the current iteration of the loop. For example, if the edge collapse transformation 1 10 of Rg. 6 .s performed at step 385^ 
£ meS. S Veca.culatesThe estimated energy cost AE of all candidate edge collapse transformations^ ,n the pnon* 
queue for the edges of faces 102-10T. The method 380 then reorders these edge «lla^ translorma^or^ ,n the pr^ 
ority queue according to their newly calculated energy cost AE. With the reordered priority queue, the method 380 

^Afte^eS the 5 |o?p at step 387 when the mesh M has been reduced to the selected number of faces, the method 
has continuous reTdution family of meshes consisting of the base mesh M° (e.g.. the mesh M resultng 

from the sequence of edge collapse transformations performed at step 385 in the loop)and a sequence * 
meshes defined by the sTored vertex split operations. At step 390. the method 380 encodes thebase mesh M° and the 
sequence of stored vertex spirt transformations to form the PM representation 130 as discussed above. 

In an alternative variation of the method 380. the step 384 of selecting the number of faces of the base mesh s 
omitted. Instead, the loop of steps 385-389 is simply repeated until the priority queue contains no more £gal edg€ > col- 
lapse transformations at the comparison step 387. The mesh M is thus reduced to its simplest form (wrth.n the condi- 
tions imposed on candidate edge collapse transformations as described above for step! ^ , discussed in the 

With reference to Fig. 20. in comparison to the mesh optimization method described in Hoppe93 (discussedin the 
"Background aS Summary of the Invention" above), the illustrated PM construction method I 38C has _ a number of 
aSages for mesh sirnp.rf ication. A key difference is that the illustrated PM construction me^od 380, ut.hzes the edge 
collapse transformation alone to sinplify the arbitrary mesh. (The mesh optimization method des ^'"^Pf 9 ^- 
lizesa set of three possible mesh transformations, edge collapse, edge split, and edge swap, selected at random.) Con- 
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sidering only edge collapses simplifies the implementation and improves performance of the illustrated PM construction 
method 380, but more importantly gives rise to the illustrated PM representation 130 (Fig. 7). 

As demonstrated by an accuracy versus conciseness graph 400, another key difference is the priority queue uti- 
lized in the illustrated PM construction method 380 for selecting the edge collapse transformations that are applied to 

5 the successive level-of-detail approximations. This allows the illustrated PM construction method 380 to produce better 
approximations to the original mesh Mat levels-of-detail intermediate the original mesh M and the base mesh h/P (e.g., 
along a path 402). By contrast, the mesh optimization scheme described in Hoppe93 randomly attempts successive 
mesh transformations, and usually achieves poorer approximations along the paths 34-36 (Fig. 2). 

As a further consequence of the priority queue selection in the illustrated PM construction method 380, the need 

io for the representation constant c rep (as well as the representation energy term E rep (M) is eliminated. As described in 
the "Background and Summary of the Invention" above, varying the value of the representation constant c rep permits a 
rough selection of the resolution of the approximating mesh (e.g., meshes M b -M d of Fig. 2 and exemplary meshes 
shown in Figs. 1(b-d)) produced by the mesh optimization method described in Hoppe93. The illustrated PM construc- 
tion method 380 instead allows the resolution of the base mesh M° to be explicitly selected (to within ±1 faces). Addi- 

is tionally, as opposed to the single mesh M b , M c , or M d (Fig. 2) produced by the Hoppe93 mesh optimization per selected 
value of the representation constant c rep , the illustrated PM construction method 380 produces a continuous-resolution 
family of meshes per run. 

Referring again to Figs. 8(a-d) for example, the meshes shown in Figs. 8(a-d) are examples of a few out of a con- 
tinuous resolution family of meshes in a PM representation produced by the illustrated PM construction method 380 
20 (Fig. 19) to approximate the example original arbitrary mesh /W(Fig. 1(a)). By contrast, the Hoppe93 mesh optimization 
produces a single one of the exemplary meshes shown in Figs. 1(b-d) to approximate the mesh M (Fig. 1(a)) per run of 
the method for a selected value of the representation constant c rep . 

Preserving surface geometry 

25 

Referring again to Fig. 19, when calculating the estimated energy cost AE at steps 382 and 388, the illustrated PM 
construction method 380 records the geometry of the original mesh M by sampling from it a set of points X. At a mini- 
mum, the illustrated PM construction method 380 samples a point at each vertex of M. The software application imple- 
menting the illustrated method 380 also includes an additional user option which, if selected by the user, samples 

30 additional points randomly over the surface of M. 

After sampling the set of points X, the method 380 evaluates terms of the estimated energy cost in expression (13) 
above. The energy terms E dist (M) and E $pnng (M) in that expression are defined as described in Hoppe93 and discussed 
in the "Background and Summary of the Invention" above. For a mesh of fixed connectivity, the illustrated method 380 
for optimizing the vertex positions to minimize E dis ^V)-¥E sprin ^(V) closely follows that described in Hoppe93. Evaluating 

35 E diS f(V) involves computing the distance of each point x ; in the set of points X to the mesh M. Each of these distances 
is itself a minimization problem 

d?( Xi ,4> v (\K\)) = min bieW || Xi - ^(b,) \\ 2 (14.[. 

40 - 

where the unknown bj is the parameterization of the projection of Xj on the mesh. In the illustrated method 380, the non- 
linear minimization of E dist (V)+E sprin g(V) is performed using an iterative procedure alternating between two steps. In 

the first step, for fixed vertex positions V, the method 380 computes the optimal parametrizations B-{b 1 b\x\} bv P ro_ 

45 jecting the points X onto the mesh. In the second step, for fixed parametrizations B, the method 380 computes the opti- 
mal vertex positions V by solving a sparse linear least-squares problem. 

When considering ecol({v s ,v$) t the illustrated method 380 optimizes only one vertex position, v s ', by performing 
three different optimizations with different starting points, i.e., 

v fli '-(l-oDv.f 1 + (a)^^ 1 (15) 



for a={0, 112, 1}, and accepts the best one. 
55 Unlike the mesh optimization method described in Hoppe93 which defines a global spring constant k for Esp^, 
the illustrated method 380 adapts k each time an edge collapse transformation is considered. Intuitively, the spring 
energy is most important when few points project onto a neighborhood of faces, since in this case finding the vertex 
positions minimizing E dist (V) may be an under-constrained problem. Thus, for each edge collapse transformation con- 
sidered, the method 380 sets k as a function of the ratio of the number of points to the number of faces in the edge col- 
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lapse transformation's neighborhood. As illustrated in Fig. 6, the neighborhood of an edge , coll apse transformation 110 
iSie set of faces 1 00-107 Using C notation, the method 380 sets k = r<4 ? W 2 : r<8 ?W< :10* where r .s the rate 
of the number of points to faces in the neighborhood. 

With this adaptive scheme, the influence of E spring (M) decreases gradually and adaptive* as the mesh is s.mph- 
fied. and the expensive schedule of decreasing spring constants used in the mesh opt.rn.zat.on method deserted .n 
Hoppe93 is no longer needed. 

Preserving scalar attributes (E S caiar) 

As described in the discussion of triangle meshes in the "Background and Summary of the Inventio n" ; above piece- 
wise continuous scalar fields are represented in the illustrated embodiment by defining scalar attributes S at the mesh 
corners. More specifically, the original mesh M generally has at each vertex vj not on* a position y e K : but a so a 
scalar attribute I e R- In addition to preserving the geometry of the original mesh M the esfmated energy cost func- 
tion used in thelllustrated PM construction method 380 additionally operates to preserve these scalar attr.butes of the 
original mesh Mtn the progressive meshes that the method 380 constructs. 

Optimizing scalar attributes at vertices. 

To capture scalar attributes of the original mesh M, the illustrated PM construction method 380 ^so samples .at 
each point « X the attribute value «, « R d - The estimated energy cost expression (1 3) above .s then ^entaed from 
the geometric energy terms expression. E^+E^V), just described to a.so measure the oMon «*~™- 

pled attribute values #{« ^ tan those of the mesh M. The geometnc energy cost express.on. 

Ea M)+E mrina (V) can be generalized in at least two ways to measure scalar attnbute value dev.at.on. 

A«ital^^ energy term E* st ) itself to measure d.stance 



in R 3+d . e.g 



d 2 (( Xi x,) ,M(K l V,Y))=min bism \(x i x,) - (^(bj ^(b,) )\\ 2 (16) 

This new distance metric can then be minimized using the same iterative approach described above and *f 
illustrated method 380. However, this minimization would be computationally expensrve since finding the optomal 
t!SSiXl^!mA point x ; would require projection in and would not be completely .ntuilve s,nce these 
parametrizations are not geometrically based. ^mated 

A second alternative generalization of the geometric energy cost expression. E^+E^ for the 
energy cost expression (13) in the illustrated method 380 utilizes a separate energyJerm. E^ ar , to measure deviation 
of SaTittriStes. in this second alternative generalization, the energy terrrrE^ is evaluated by mmimizing the 
expression (14) as discussed above (i.e.. the parametrizations />, are determined using only geometry). The separate 
eS^erm; Lin in the estimated' energy go* expression (13) measures attnbute deviation based on these para- 
metrizations: 

E ecalar (V) = (Scalar) 2 li II Xi"*.^)! 1 (17> 



where the constant Cscalar assigns a relative weight between the attribute errors (£ scalar ) and the geometric e nrors 
The constant can be set by the software application, or varied by the computer user wrth a user .rrterface 
control supplied by the software application. 

EfVW-E^WUE™ (V)+E scalai <V), the illustrated method 380 first finds the vertex position v s minimizing 
I fv')!? ( M%^™%y p^<*W the points onto the mesh (obtaining the parametrizations bj) and solving a 
*Z leasT^uares problem. Then, using those same parametrizations b h it finds the vertex attribute * m 
Scl 5 soMng a single linear least-squares problem. This has negligible performance overhead as compared to the 
first alternative generalization. — , ^ , 

With reference to Figs. 21(a-c) and 22(a-c). by letting AE scator contribute to the estimated cod t A£ of an nedge col 
lapse the illustrated PM construction method 380 obtains simplified meshes whose faces naturally adapl t to the 
SSrte fields For example, by minimizing AE^,. the method 380 (Fig. 1 9) is able to select edge collapses that pre- 
se^rSex scalar aSribute field (i.e.. colo? of an original mesh 420 (Fig. 21 (a)) having trivia, geomefry (a square) 
fn producing a simplified mesh 422 (Figs. 21 (b-c)). In this example, the 200x200 vertices of the or.g.nal mesh 420 are 
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reduced by the method 380 to just 400 vertices in the simplified mesh 422 while retaining much of the color quality. 

As another example the method 380 selects edge collapses to preserve another scalar attribute, radiosity of 
anotSr o"Sina. mesh 430 (Fig. 22(a)) having 150.983 faces to produce a simplified mesh 432 (Fig. 22(b-c)) hav.ng 
10,000 faces. 

Optimizing scalar attributes at corners. 

The above described minimization of AE scatef is also utilized by the illustrated PM constr "^ion method 380 when 
optimizing the scalar corner attributes S. At each vertex v jt instead of solving for a angle unknown attrtoute value ^the 
illustrated method 380 partitions the corners into continuous sets (based on equivalence of corner attnbutes) and for 
each continuous set solves independently for its optimal attribute value. 

Range constraints 

The illustrated method 380 also accounts for scalar attributes having constrained ranges. For instance, the compo- 
nents (rg b) of color are typically constrained to lie in a range between 0 and 1. The least-squares m.n.m^at.on of 
SI I may yield color vabes outside this range. In cases where scalar attributes have construed ranges, the ^us- 
TraS method 380 clips the optimized values to the given range. For least-squares mmirwafon of a EuCdean norm, 
this is in fact optimal. 

Normals 

Surface normals (n, n v ,n 2 ) are typically constrained to have unit length, and thus their domain is non-Cartesian. 
OptimlTove^rmLs wou.d therefore r.quire minimization of a nonlinear functional ™th non.inear -nstra.nt. The 
Strated method 380 instead simply carries the normals through the simp.ificat.on process. Speedily the method 
380 computes the new normals at vertex V J by interpolating between the normals at vertces y 
using the a value that resulted in the best vertex position vj in minimizing the geometry energy term AE dis , as 
SbS above. Fortunately, the absolute directions of norma.s are less visually imprtnl than 
wSch arepreserved by the estimated energy cost expression in the illustrated method 380. as desenbed below. 

Preserving discontinuity curves (E disc ) 

Appearance attributes give rise to a set of discontinuity curves on the mesh, both from differences betweer , dfecrete 
faceTttributes (e g . material boundaries), and from differences between scalar corner attnbutes (e.g., creases an^ 
shadow SaNes . More specifically, the attributes D and S give rise to discontinuities in the v.sual appearance of the 
mesTA^dge Stf of the^esh is said to be sharp if either (1) it is a boundary edge. (2) rtstwo adjac effaces J, a p d 
Thave diffe?en discrete attrbutes (i.e.. d„ * d f2 ), or (3). its adjacent corners have drffere* scalar attnbutes M 
s „*s, „, or „*s fuk «,)• Together, the set of sharp edges define a set of d.scont.nu.ty curves over the mesh 
Jft SSS! 8(a V As these discontinuity curves form highly noticeable features, it is .mportant to 

P ^i™ 

the topology of the discontinuity cu-ves by testing some local conditions. Specifically, .et <^-^<^"» <£* " 
edge Lvjis sharp, and let #sharp{ Vj } be the number of sharp edges adjacent to a vertex £ Then, refemng , to F g. 6 
Se edge collapse transformation 1 10 of an edge M modifies the topology of d. scont.nu.ty" curves* either. (1 
sharpiv^}^ shantvMh °' sharpfv^ and sharp^ , or (2) MtfVJtf and ^^J n f^ 
shamiwl or (3) #sharp{v^3 and #sharp{v^3 and sharp{v s .vj. or (4) sharp^.vj and #sharp{v^1 and 
#sharDfv>)*2 or (5) sharp{v St Vt} and #sharp{v$=1 and #sharp{Vs}*2. 

^^VL^JtiLti* can be employed in the PM construction method 380 to preserve ^corrtmurty 
curves using the above described tests. One alternative strategy (hereafter referred to as the d.scont.nurty curve 
strSl to Tmply disallow an edge collapse if these tests show that the edge collapse would I modrfy he topology of 
SsSS cur^s A more sophisticated afternative strategy which permits, buts penalizes changes to d.scontinuity 

CU "toX^^^^ ot the discontinue curves, the illustrated method 380 further samplesa n additional 

set of points X disc from the sharp edges of M and defines an additional energy term E asc in the estimated energy cost 
expnSS e^ual to the total squared distances of each of these points to the discontinue curve frorr .which ^ ^as 
saS In other words, E disc is defined just like E dist . except that the points X disc are constra.ned to project onto a set 
mesh^ln effect, the method 380 solves a outfitting problem embedded wrthin the overall surface 
fitting problem. Since all boundaries of the surface are defined to be discontinuity curves, our procedure preserves 
boundary geometry more accurately than Hoppe93. 
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Referring to Figs. 23(a-c). the benefit of employing the additional E disc energy term in the energy cost expression 
(13) is demonstrated by the simplified meshes 440 (Fig. 23(a)), and 442 (Fig. 23(b)). Both meshes 440 and 442 were 
simplified to 2000 faces, only the mesh 440 was simplified without the E aisc energy term in the energy cost expression 
(13) whereas the mesh 442 was simplified with the E disc energy term. As a result, the mesh 442 .s a much better 
approximation visually of the original mesh than the mesh 440 due to discontinuity curve preservation. This is particu- 
larly apparent with respect to the topology of the discontinuity curves defining the windows in the model. Some oi the 
discontinuity curves of the mesh are indicated with yellow lines in Figs. 23(a-c). 

Permitting changes to topology of discontinuity curves. 

Referring still to Figs 23(a-c), some meshes contain numerous discontinuity curves, and these curves may delimit 
features that are too small to be interesting when viewed from a distance. In such cases, strictly preserving the topology 
of the discontinuity curves unnecessarily curtails simplification. In an alternative strategy for preserving disconnnurty 
curves, the PM construction method 380 permits changes to the topology of the discontinuity curves, but penalizes 
such changes. When a candidate edge collapse ecol({v s . Vl }) changes the topology of the discontinuity curves of the 
mesh, the method 380 adds to its estimated energy cost AE the value 

l**c./to.»fl|- i v s-v,i 2 (18) 

where \X disc , vs w ,| is the number of points of X disc currently projecting onto {v s ,v^. 

That sS>Te strategy, although ad hoc, has proven very effective. To illustrate, mesh 442 (Fig. 23(b)) was simplified 
by the method 380 using the fixed discontinuity curve preservation strategy to 2000 faces, while mesh 444 (Fig. 23(c)) 
was simplified to 2000 faces by the preservation strategy which only penalizes changes to discontinuity curves. With 
the strategy allowing discontinuity curve changes, the thin dark gray window frames are allowed to vanish .n the mesh 
444. In the mesh 442. however, the fixed discontinuity curve preservation strategy forces the window frames to stay, 
resulting in a poorer quality simplified mesh. 

The illustrated PM construction method 380 (Fig. 19) is one of many possible PM construction methods wrth vary- 
ing trade-offs of speed and accuracy. A much simpler alternative PM construction method is to select legal edge col- 
lapse transformations at random. (Some local conditions must be satisfied for an edge collapse to be legal i e.. 
manifold preserving described in Hoppe93.) While crude, this scheme has the advantage of being very fast ^Unfortu- 
nately, this method generally provides poorer low level-of-detail approximations (i.e.. the progressive meshes M closest 
to the base mesh Hf° in the progressive mesh sequence) to the original arbitrary mesh M. 

A less crude alternative PM construction method uses a simple heuristic, such as the "distance to plane metnc 
described in Schroeder-etal92. as a basis for improving the edge collapse selection strategy. 

Having described and illustrated the principles of my invention with reference to an illustrated embodiment, it w.M 
be recognized that the illustrated embodiment can be modified in arrangement and detail without der^artng from such 
principles. It should be understood that the programs, processes, or methods described herein are not related or hmrted 
to any particular type of computer apparatus, unless indicated otherwise. Various types of general purpose or special- 
ized computer apparatus may be_used with or perform operations in accordance with the teachings described herein. 
Elements of the illustrated embodiment shown in software may be implemented in hardware and vice versa. 

In view of the many possible embodiments to which the principles of my invention may be applied, it should be rec- 
ognized that the detailed embodiments are illustrative only and should not be taken as limiting the scope of my inven- 
tion. Rather. I claim as my invention all such embodiments as may come within the scope and spirit of the following 
claims and equivalents thereto. 

Claims 

1 In a computer, a method of simplifying an arbitrary initial mesh having a plurality of vertices and a connectivity of 
the vertices defining edges between connected pairs of the vertices and faces defined by plural connected edges 
for representing multi-dimensional objects with computer graphics, comprising: 

(a) choosing an edge of the mesh; 

(b) performing an edge collapse transformation on the edge to produce a simpler mesh wherein the pair of ver- 
tices connected by the edge is replaced by the edge collapse transformation with a single vertex; and 

(c) performing a plurality of iterations of the steps (a) and (b) to produce a base mesh having a desired level of 
detail. 

2. The method of claim 1 further comprising: 
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(d) performing the iterations of the steps (a) and (b) until the simpler mesh has a level of detail equal to a sim- 
plest mesh of a same topological type as the initial mesh. 

3. In a computer, a method of constructing a variable resolution representation of a multi-dimensional object from 
an arbitrary initial mesh representation of the object for displaying computer graphics views of the object, the arbi- 
trary initial mesh having a plurality of vertices and a connectivity of the vertices defining a plurality o1 edges 
between connected pairs of the vertices, the method comprising: 

choosing a succession of mesh simplifying transformations that, when applied successively beginning with the 
arbitrary initial mesh, yield a succession of progressively simpler meshes, and a last in the succession of mesh 
simplifying transformations yielding a base mesh; and 

recording the base mesh and a succession of mesh refining transformations which are an inverse of the mesh 
simplifying transformations and in a reverse order of the succession of mesh simplifying transformations, the 
mesh refining transformations exactly reproducing the arbitrary initial mesh when applied successively begin- 
ning with the base mesh. 

6. The method of claim 5 wherein the mesh simplifying transformations are all edge collapse transformations, the 
method further comprising, for each of the succession of progressively simpler meshes beginning with the arbitrary 
initial mesh: 

choosing a current edge collapse transformation out of a plurality of candidate edge collapse transformations 
on a current mesh of the succession of progressively simpler meshes; and 

applying the edge collapse transformation to the current mesh to yield a next mesh in the succession of pro- 
gressively simpler meshes. 

7. The method of claim 6 wherein the step of choosing the current edge collapse transformation comprises: 

calculating an appearance metric for each of the candidate edge collapse transformations; and 
choosing the current edge collapse transformation out of the candidate edge collapse transformations to opti- 
mize the appearance metric. 

8. The method of claim 7 further comprising: 

imposing a predetermined maximum dihedral angle restriction and a manifold preservation restriction on the 
candidate edge collapse transformations. 

9. The method of claim 7 wherein the step of calculating the appearance metric for each of the candidate edge col- 
lapse transformations comprises: 

measuring a geometric deviation between the initial arbitrary mesh and a mesh resulting from applying the 
candidate edge collapse transformation to the current mesh. 

10. The method of claim 7 wherein the step of calculating the appearance metric for each of the candidate edge 
collapse transformations comprises: 

sampling geometric attributes at a plurality of points on a surface of the initial arbitrary mesh; 

measuring a geometric deviation between the geometric attributes of the initial arbitrary mesh at the points and 

a resultant mesh resulting from applying the candidate edge collapse transformation to the current mesh; 

accumulating the geometric deviation with a spring term having an adaptive spring constant; and 

setting the adaptive spring constant according to a ratio of a number of the points to a number of faces in a 

neighborhood of the edge collapse transformation. 

11 . The method according to any one of claims 7 or 9 wherein the step of calculating the appearance metric for 
each of the candidate edge collapse transformations comprises: 

measuring a scalar attribute deviation between the initial arbitrary mesh and a mesh resulting from applying 
the candidate edge collapse transformation to the current mesh. 

12. The method of claim 7 wherein the step of calculating the appearance metric for each of the candidate edge 
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collapse transformations comprises: 

sampling geometric attributes at a plurality of points on sharp edges of the initial arbitrary mesh; and 
measuring a geometric deviation between the geometric attributes at the points and sharp edges of a mesh 
resulting from applying the candidate edge collapse transformation to the current mesh. 

13. The method of claim 7 wherein the step of choosing the current edge collapse transformation comprises: 

checking whether a choice for the current edge collapse transformation modifies a discontinuity curve topology 
of the current mesh; and 

disallowing the choice if the choice modifies the discontinuity curve topology. 

14. The method of claim 7 wherein the step of choosing the current edge collapse transformation comprises: 

checking whether a choice for the current edge collapse transformation modifies a discontinuity curve topology 
of the current mesh; and 

penalizing the choice rf the choice modifies the discontinuity curve topology. 

15. A computer based system for constructing a variable resolution representation of a multidimensional object 
from an arbitrary initial mesh representation of the object for displaying computer graphics views of the object, the 
arbitrary initial mesh having a plurality of vertices and a connectivity of the vertices defining a plurality of edges 
between connected pairs of the vertices, the system comprising: 

a mesh transformation processor for iteratively choosing a mesh simplifying transformation, and applying the 
chosen mesh simplifying transformation to a current mesh in a succession of progressively simpler meshes 
beginning with the initial arbitrary mesh to yield a next mesh in the succession, a last in the succession of mesh 
simplifying transformations yielding a base mesh; and 

an encoder for recording the base mesh and a succession of mesh refining transformations which are an 
inverse of the mesh simplifying transformations and in a reverse order of the succession of mesh simplifying 
transformations, the mesh refining transformations exactly reproducing the arbitrary initial mesh when applied 
successively beginning with the base mesh. 

16. The computer based system of claim 15 comprising: 

a user interface control for selecting a desired level of detail; and 

the mesh transformation processor performing iterations of choosing and applying the mesh simplifying trans- 
formations until applying a last of the mesh simplifying transformation yields a next mesh having a level of detail 
at least as simple as the desired level of detail. 
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FIG. 10(d) FIG. 10(e) 
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FIG. 12A 
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